Enhancing Monte Carlo methods by using a generahzed fluctuation theory 



o 
o 

o 

Q 

(N 



I 

o 
o 



> 
m 

00 
(N 

O 



X3 
O 

o 



X 



L. Velazquez 

Departamento de Fwica, Universidad de Pinar del Rio, 
Marti 270, Esq. 27 de Noviembre, Pinar del Rio, Cuba. 

Abstract 

According to the recently obtained thermodynamic uncertainty relation {SpSE) = 1 + {(P S / dE^^ (SE^^, the microcanonical 
regions with a negative heat capacity can be accessed within a canonical-hke description by using a thermostat with a fluctuating 
inverse temperature. This far-reaching conclusion is used in this Letter for enhancing the potentialities of the well-known 
Swendsen-Wang cluster algorithm in order to access to the anomalous microcanonical states of the g = 10 state Potts model 
on a square lattice L x L, which exhibits a first-order phase transition in its thermodynamical description. 



The present approach for enhancing the Monte Carlo 
methods based on the equilibrium distributions of the 
Statistical Mechanics [H is straightforwardly followed as 
a direct application of a non Riemannian framework of 
the Equilibrium Thermodynamics recently proposed in 
the refs.[3, Q. A fundamental result derived from this 
theory is the following thermodynamic identity: 



{6(3dE) = 1 



dE^ 



{5E-) 



(1) 



where (3 characterized the effective inverse temperature of 
certain generalized thermostat and E the total energy of 
the interest system. This expression generalizes the well- 
known relation C — {^E^} between the heat capacity 
C = dE/dT and the energy fluctuations within the Gibbs 
canonical description towards all those microcanonical 
regions hidden by the ensemble inequivalence, that is, all 
those energetic regions characterized by the presence of 
negative heat capacities 
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dS_ 

dE 
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(2) 



associated to the convex character of the Boltzmann en- 
tropy 5 = In W^. 

The thermodynamic identity ([1]) naturally appears 
within the generalized framework under the hypothesis of 
the ensemble equivalence. Thus, the ordinary condition 
(5/3 = associated to the Gibbs canonical description is 
only admissible wherever the entropy be a concave func- 
tion d'^S/dE'^ < (convex-down). The identity ^ leads 
to the following inequality: 



(SPSE) > 1 



(3) 



wherever the entropy be locally convex d'^S/dE^ > 
(convex-up). This means that the anomalous regions 
with a negative heat capacity could be only accessed by 
using a generalized thermostat exhibiting correlated fluc- 
tuations of its effective inverse temperature P with the 
fluctuations of the total energy E of the interest system. 
This far-reaching conclusion could be a fundamental in- 
gredient for allowing the improvement of many Monte 



Carlo algorithms based on the Gibbs canonical ensem- 
ble for deal with the presence of flrst-order phase transi- 
tions without the necessity of appealing to multicanoni- 
cal methods 0] . The aim of the present Letter is to show 
a numerical evidence which seems to support the above 
ideas. 

The reader can also notice that the inequality ([3]) 
looks-like an uncertainty relation, which allows us to 
claim that the inverse temperature of the thermostat /3 
and the total energy of the interest system E can be 
considered as complementary thermodynamical quanti- 
ties within the regions of ensemble inequivalence. The 
energy fluctuations SE can not be reduced there without 
an increasing the fluctuations of the inverse temperature 
(5/3 of the generalized thermostat, and vice versa. Thus, 
the identity ([T]) can be referred as a thermodynamic un- 
certainty relation since it imposes certain restrictions to 
the determination of the microcanonical caloric curve. 

The understanding of the methodology introduced in 
this Letter demands to carry out a summary of the geo- 
metric foundations leading to the thermodynamic uncer- 
tainly relation ([1]). I shall only exposed here the funda- 
mental points, so that, the interested reader should see 
the refs.[3,[^ for more details. 

Let be an isolated Hamiltonian system iJjv whose 
macroscopic description can be performed starting from 
microcanonical basis by considering only the total energy 
E = Hpf. Let Q — Q (E) be any diffeomorflsm (a bijec- 
tive and piece-wise differentiable function) of the total 

energy E. It is said that the functional Bat ~ 8 ( Hn 



constitutes a reparametrization of the Hamiltonian Hj^. 
It is easy to show that the Physics within the micro- 
canonical description is reparametrization invariant: 



OJM (E) 
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i^M (6) . (4) 



The demonstration is straightforwardly followed from 
the properties of the Dirac function. Such feature im- 
plies that the microcanonical average (A) — Sp (^lunA^ 

of any microscopic observable A is also reparametriza- 
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tion invariant, (A) {E) = {A) (0), that is, these aver- 
ages can be taken as scalar functions under the energy 
reparametrization changes. The microcanonical partition 
function Q (8, N) ^ Sp ^6 6 — Oat | allows us to intro- 
duce the invariant measure of the phase space volume: 



dn = n (6, N)de^n (e, n) dE, 



(5) 



which leads to an reparametrization invariant definition 
of the microcanonical entropy = In Wa , where Wa = 
dfi, being a subset of certain coarsed grained par- 
tition of the phase space. Such a coarsed grained nature 
of the entropy can be disregarded in the thermodynamic 
limit N oo and this thermodynamic potential can be 
considered as a continuous scalar function. The estima- 
tion Wa — ^ {&, N) SQq can be used whenever the subset 
Sq, be small, a condition which is always justified when 
N is large enough without any lost of generality 

The concavity of a scalar function as the microcanon- 
ical entropy S depends crucially on the reparametriza- 
tion used for describing the thermodynamical properties, 
which is explained by the presence of the term dS/dO 
in the transformation rule of the entropy Hessian during 
the reparametrization E ^ Q: 



dE^ 
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with 
2 after 



A trivial example is the concave function s (x) 
a; > 0, which becomes a convex function s (y) = y 
consider the reparametrization y = ^fx. 

The concavity of the microcanonical entropy is an im- 
portant condition for the ensemble equivalence. The 
modifying of the entropy convex properties during the 
energy reparametrization changes is a very simple al- 
ternative for ensure the ensemble equivalence within a 
canonical-like description. This kind of framework de- 
mands the introduction of the called generalized Gibbs 
canonical ensemble: 



exp 



N 



(7) 



which describes the equilibrium conditions of the inter- 
est system under the external influence of a generalized 
thermostat with generalized canonical parameter 77. It 
is easy to show that this distribution function is derived 
within the Jaynes reinterpretation of the Thermodynam- 
ics in terms of the Information theory [5] by imposing the 
constrain: 



(e) = ^e(£;,) 



(8) 



instead of the usual energy constrain with 8 (E) = E, 
a viewpoint recently developed by Toral in the ref. ^"j. 
This last observation clarifies us that the role of the gen- 
eralized thermostat is precisely to impose the constrain 



The generalized partition function Z (77, N) = 
Sp |exp — TyO^vj | can be rewritten in terms of the mi- 
crocanonical partition function fl {E, N) as follows: 

Z [f], N)^ j exp [-r/e] {E, N) dE 

= j exp [-776] n (9, N) de, (9) 

where the invariant character of the measure ([5|) possi- 
bilities us to rephrase the generalized partition function 
as an usual Laplace transformation. The imposition of 
the thermodynamic limit N 00 leads to the validity 
of the Legendre transformation between the Thermody- 
namic potentials P and S: 



P(77)-inf{779-5(9,7V)}, 



(10) 



being P {rj, N) = — In Z (77, N) the Planck potential asso- 
ciated to the generalized canonical ensemble when- 
ever there is only one point 9* satisfying the stationary 
conditions: 



^ ■ — - and Ave = ^ — - < 0. (11) 



within the energy reparametrization 9 = 9 {E). 

While the microcanonical ensemble is reparametriza- 
tion invariant the generalized Gibbs canoni- 
cal description ([7]) depends crucially on the energy 
reparametrization. Nevertheless, these equilibrium sta- 
tistical descriptions becomes asymptotic equivalent with 
the imposition of the thermodynamic limit N ^ 00 with 
the exception of all those microcanonical regions where 
the convex-down character of the entropy S in the energy 
reparametrization 9 can not be ensured. 

The reader can notice that the using of energy 
reparametrizations 9 = 9 {E) allows us to extend many 
results and methodologies of the standard Thermody- 
namics and Boltzmann-Gibbs Statistical Mechanics with 
a simple change of reparametrization {f3,E) =^> (?7, 9). 



This viewpoint was considered in the ref.[3j for intro- 
duce a variant of the Metropolis importance sample al- 
gorithm [3l based on the generalized canonical weight 
exp [— 77A9] instead on the usual exp{—PAE), being 
A9 = 9 (£; -I- AE) - 9 {E). Since \AE\ « \E\ during 
a Metropolis move when N is large enough, the approx- 
imation A9 ~ 99 (E) /dE * AE allows us to rephrase 
the corresponding acceptance probability p: 



p ~ mm 



exp 



-PAE 



(12) 



as an ordinary Metropolis move with a variable inverse 
temperature: 



P = P{E-r])^r, 



oe [E) 

dE ' 



(13) 
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This results allows us to understand that the general- 
ized thermostat associated to the ensemble (O can be 
taken without any lost of generality when N is large 
enough as an ordinary Gibbs thermostat with a vari- 
able inverse temperature which fluctuates around 
the equilibrium value P* — (3 {E* ; 77) , being E* the equi- 
librium energy corresponding to the stationary point 
Q* — Q{E*). The inverse temperature fluctuations of 
such generalized thermostat S(3 = P {E; r]) — /3 {E*;ri) ~ 
(779^6 (£■*) /dE'^) * SE are correlated to the energy fluc- 
tuations of the interest system SE = E — E* as follows: 



(SPSE) ~ rj 



d^e [E* 
dE^ 



. {5E^) 



(14) 



Taking into account the approximation 5Q = Q [E] — 
e{E*) ~ [de {E*) /dE] * SE and the well-known rela- 
tion between the fluctuations ((50^) with the entropy 
Hessian d^S/dQ^ within the Gaussian approximation 
(^e^) ~ - {d^S (6*) /dQ^y^ (now in terms of the en- 
ergy reparametrization Q), the inverse of the average 
square dispersion of the energy {SE'^'^ can be expressed 
as follows: 



{sEr'=- 



/ de {E* 
\ dE 



992 



(15) 



Finally, by combining the stationary condition (jllD and 
the transformation rule (151): 



dS d^S 



dE^ de dE^ dE^ 
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as well as the equation (|15p . the thermodynamic uncer- 
tainty relation ([T]) is obtained. 

Let us now consider that the interest system becomes 
extensive with the imposition of the thermodynamic limit 
and the same one exhibits an ensemble inequivalence in- 
side the energy interval (ei, £2), where 92s (e^) /9e2 < 0, 
being e = E/N and s — S/N the energy and the en- 
tropy per particle respectively. Everything that should 
be taking into consideration for the convergence of the 
Metropolis algorithm described above is the using of an 
appropriate energy reparametrization 9 = 9 (E) Q . 
Obviously, there exist an undeterminable number of pos- 
sibilities in order to perform such selection. 

A convenient choice of the energy reparametrization 
under the above background conditions is given by 
9 (E) — Nip {E/N), where the first derivative of the bi- 
jective function (p (e) is taken as follows: 



He) 



d(p (g) 
de 



= exp [-A (£2 - e)] 



(17) 



being A a large enough positive constant |3|]- Thus, the 
effective inverse temperature of the thermostat in terms 
of the instantaneous value of the energy per particle e 
of the interest system is given by (3{e;ri) = 77^ (e). It 



can be verified that an unnecessary large value of A leads 
to an increasing of the inverse temperature fluctuations. 
An appropriate prescription for the value of A is given by 
A ^ Pc^^ being /3c an estimation of the critical inverse 
temperature of the first-order phase transition. Each 
point of the caloric curve /3 versus e is determined from 
the averages (e) and (/3 (e; 77)) taken from a Metropolis 
dynamics by keeping fixed the canonical parameter 77 of 
the generalized thermostat. The second derivative of the 
entropy per particle is obtained from the thermodynamic 
uncertainty relation ([T]). The whole simulation can start 
from rj — being P2 the corresponding inverse tempera- 
ture at the point £2, where 77 is increased until the caloric 
curve be obtained for all the energetic interval (£i,£2)- 

The variant of the Metropolis algorithm described 
above seems to be a very general alternative to avoid 
the anomalies related with the presence of a first-order 
phase transitions in the short-range interacting systems. 
An example of application was presented in the ref. Q in 
order to obtain the microcanonical caloric curve of the 
q = 10 states Potts model [1]: 



H 



N 



(18) 



on a square lattice with N = L x L with periodic bound- 
ary conditions, whose microcanonical description shows 
the existence of a first-order phase transition. The sum 
is over pairs of nearest neighbor lattice points only and 
(Tj is the spin state at the i-th lattice point. 

Generally speaking, any Metropolis algorithm is more 
inefficient than other nonlocal Monte Carlo methods in- 
volving clusters algorithms. However, the use of such 
clusters algorithms can be limited by the phenomenon 
of the ensemble inequivalence. For example, the clusters 
algorithms for the Potts model P are based on a map- 
ping of this model system to a random clusters model of 
percolation throughout the equation: 



Z = ^ exp \-PHn] = J2 I'^'P' (1 - P) 



.Nd-b 



(19) 



b is the number of bonds, Nr the 



where p = 1 — t 
number of clusters and d the dimension of the lattice. 
Whilst such Monte Carlo methods allow in general an ef- 
ficient calculation of the thermodynamic properties of the 
Potts models, they can undergo a supercritical slowing 
down whenever an ensemble inequivalence exists within 
the canonical description. 

The ensemble inequivalence can be avoided by using 
the generalized canonical description ([7]) instead of the 
usual canonical description. A very important question 
is how to develop suitable clusters algorithms within the 
framework of the generalized canonical ensemble ([7]). A 
serious obstacle is the nonlinear character of the energy 
reparametrization 9 = 9 (E), i.e.: the linear character of 
the energy reparametrization 9 (E) = E is crucial for the 
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FIG. 1: Caloric /3 (e) and curvature n (e) curves obtained 
from the Metropolis algorithm and the Swendsen-Wang clus- 
ter algorithm using thermostats associated to the generalized 
canonical ensemble (GCE) as well as the canonical ensemble 
(CE) by considering 10^ iterations for each point. 



mapping of the Potts model described by the equation 
(fT9)) . However, there could be a very simple way to avoid 
such difhculties. The reader can notice that the ther- 
modynamic uncertainty relation ([T]) does not make an 
explicit reference to the particular energy reparametriza- 
tion O {E) used during its derivation. This remarkable 
feature suggests us that actually there is not needing to 
perform an exact Monte Carlo implementation of the gen- 
eralized canonical ensemble ^ when the system size N 
is large enough, that is, all that it needs to demand in 
order to avoid the ensemble inequivalence is the using of 
a generalized thermostat with a fluctuating inverse tem- 
perature. 

Such a working hypothesis leads to propose the follow- 
ing scheme for enhancing the potentialities of any Monte 
Carlo algorithm based on the Gibbs canonical ensemble 
in order to deal with the ensemble inequivalence: (1) To 
generate a new configuration Xi from the previous con- 
figuration Xi-i by using a Monte Carlo method with 
constant inverse temperature /3; (2) Redefine the inverse 
temperature of the thermostat f3 — f3 {E; rj) of the next 
configuration by using the energy E — Hm {Xi) of the 
present configuration Xi. The function (3{E]r]) can be 
taken as the effective inverse temperature ([T3| associ- 
ated to the Metropolis algorithm based on the general- 
ized canonical ensemble ([7]). The microcanonical caloric 
curve P {e) = ds (e) /de can be obtained from the av- 
erage values of the energy (e) and the inverse tempera- 
ture = 77 (^(e)), while the curvature or the second 
derivative of the entropy per particle k (e) = d^s (e) /de'^ 
by means of the relation k{s) = ((JpcTe — 1) /erf, being 



0-2 = TV cjI=N (SP"^) and C (e) the function (fTTl). 

A complete analysis about the applicability and the 
convergence of the procedure proposed above to any 
Monte Carlo algorithm based on the Gibbs canonical en- 
semble seems to be at a first glance a very difficult math- 
ematical task. Nevertheless, the thermodynamic relation 
^ constitutes by itself a general result supporting in 
principle the applicability of such methodology. 

Numerical evidences seems to be in agreement with the 
present viewpoint. The FIG[1] shows a study where the 
above procedure was employed in order to combine the 
potentialities of the well-known Swendsen-Wang cluster 
algorithm (SW) i and the use of a generalized ther- 
mostat with a fluctuating inverse temperature in order 
to access to the microstates with a negative heat capac- 
ity presented in the thermodynamical description of the 
g = 10 states Potts model (IT8|) . A previous simulation 
(by using the usual Metropolis or SW algorithms) allows 
to set the interest energetic window between ei = 0.2 
and 62 = 1.2 which encloses the region of ensemble in- 
equivalence of this model for L — 25. The inverse critical 
temperature was estimated as Pc — 1-4, allowing us to set 
A = 0.8. The reader can notice that while the SW algo- 
rithm with a constant temperature is unable to reproduce 
the backbending behavior of the microcanonical caloric 
curve, the use of a thermostat with a fluctuating inverse 
temperature avoids such limitation both for this cluster 
algorithm as well as the Metropolis one. The agreement 
between these last Monte Carlo methods is remarkable. 

Thus, the analysis of the thermodynamic uncertainty 
relation ([T|) consequences opens a whole world of the- 
oretical developments and numerical studies about the 
enhancing of the available Monte Carlo methods based 
on the canonical ensemble in order to deal with the en- 
semble inequivalence phenomenon without appealing to 
the multicanonical methods yb]. 
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